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Chapter  1 


INTRODUCTION 

The  development  of  new  air  launched  tactical  guided 
missiles  is  a continuing  process  within  the  U.S.  Air  Force. 
Recently,  increased  emphasis  has  been  placed  on  designing 
systems  for  support  due  to  the  significant  impact  of  support 
costs  on  the  total  life  cycle  cost  (LCC)  of  a system.  For 
example,  Warner  Robins  Air  Logistics  Center  (WR-ALC)  has 
estimated  the  annual  operation  and  support  (O&S)  costs  for 
the  AIM-7F  and  AIM-9L  missile  systems  to  be  $6.92  million 
and  $4.53  million,  respectively,  for  quantities  of  10,000 
each. 

A large  portion  of  these  O&S  costs  were  comprised 
of  depot  overhaul  costs.  For  the  AIM-7F  and  AIM-9L,  annual 
depot  overhaul  costs  were  estimated  to  be  $5.45  million  and 
$3.28  million,  respectively,  or  approximately  80  percent 
and  73  percent  of  total  annual  O&S  costs  (13) . Of  these 
depot  overhaul  costs,  the  single  most  important  factor  is 
the  depot  overhaul  of  guidance  and  control  subsystems  (GCS) 
(14) , the  "brains"  of  a guided  missile,  which  may  account 
for  as  much  as  80  percent  of  missile  acquisition  cost  (1:5). 
The  portions  of  the  WR-ALC  annual  O&S  cost  models  for  the 
AIM-7F  and  AIM-9L  which  compute  total  annual  GCS  depot 
overhaul  costs  (DC)  are  as  follows: 
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AIM-7F  DC  = (.Of. 70  - .000061F  + FZ)OHC 

AIM-9L  DC  - (.0160  - .00003F  + F7.)OHC 

The  variables  contained  in  those  equations  aro  identified 
in  Table  1.1,  04.S  Cost  Estimate  Data,  along  with  the  values 
used  by  WR-ALC  in  determining  the  estimates  ot  total  annual 
O&S  costs.  Using  these  values  in  the  above  equations,  the 
resultant  estimates  for  total  annual  GCS  depot  overhaul 
costs  are  $5.43  million  for  the  AIM-7F  and  $3.25  million  for 
the  ATM-9L. 


Table  1 . 1 

O&S  Cost  Estimate  Data 


Variables 

AIM-7F 

AIM-9L 

Missile  Inventory  (0) 

10,000 

10,000 

Annual  Flyinq  Hours  per 
Missile  on  Aircraft  (F) 

1.000 

20,000 

Failure  Rate  per 

Flyinq  Hour  (Z) 

.00870 

.01942 

GCS  Depot  Overhaul 

Unit  Cost  ( OHC ) 

$8,000 

$4,353 

When  compared  with  the  previous  cost  estimates  for  total 
annual  missile  depot  overhaul  ($5.45  and  3.28  million),  it 
can  be  seen  that  virtually  all  of  the  depot  overhaul  costs 
for  these  missiles  are  associated  with  the  overhaul  of  the 
GCS.  Additionally,  sensitivity  analyses  of  total  annual 
O&S  cost  relative  to  changes  in  GCS  depot  overhaul  unit  cost 
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(OHC)  indicated  that  a 10  percent  change  in  OHC  resulted  in 
a 7.8  percent  change  in  total  annual  O&S  cost  for  the  AIM-7F 
and  a 7.2  percent  change  in  total  annual  O&S  cost  for  the 
AIM-9L. 

Despite  the  importance  of  GCS  depot  overhaul  unit 
cost,  the  WR-ALC  O&S  cost  model  does  not  have  the  capability 
to  forecast  this  cost.  Instead,  this  model,  as  well  as 
other  current  LCC  models  for  tactical  missiles,  requires  an 
externally  derived  estimate  of  this  cost  as  input  data. 

There  is,  however,  no  known  validated  method  for  deriving 
this  estimate  prior  to  actual  depot  overhaul  (14;  16). 

Statement  of  the  Problem 

Accurate  estimating  techniques  have  not  been 
developed  to  forecast  the  cost  of  tactical  missile  guidance 
and  control  subsystems  depot  overhaul  during  system  devel- 
opment . 

Objectives 

The  first  objective  of  this  research  was  to  identify 
the  most  important  variables  for  determining  the  cost  of 
tactical  missile  GCS  depot  overhaul. 

The  second  objective  was  to  use  the  variables  to 
develop  a cost  estimating  relationship  model  which  could  be 
used  during  tactical  missile  system  development  for  fore- 
casting GCS  depot  overhaul  cost. 
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Research  Questions 


1.  What  variables  are  important  in  determining  the 
cost  of  tactical  missile  GCS  depot  overhaul? 

2.  What  cost  estimating  relationships  would  be 
useful  in  forecasting  GCS  depot  overhaul  cost  during  tac- 
tical missile  system  development? 


BACKGROUND  AND  JUSTIFICATION 


Background 


years,  as  depicted  in  Figure  2.1,  shows  the  decreasing  share 
of  resources  being  allocated  to  the  Department  of  Defense 
(DOD) . DOD's  share  of  the  federal  spending  has  decreased 


DISTRIBUTION  OF  FEDERAL  SPENDING 


PERCENT 


ALL  OTHER  AGENCIES 


TREASURY 


DOD 


PROJECTION 


from  approximately  45  percent  in  1962  to  a projected  25 
percent  in  1980  (2:p.l-20).  This  decrease  in  total  DOD 
spending  has  been  compounded  by  rapidly  rising  manpower 
costs  and  the  growing  sophistication  and  complexity  of 
weapon  systems.  Although  high-level  attention  primarily 
focuses  on  research  and  development  (R&D)  and  acquisition 
costs,  the  greatest  costs  over  the  life  of  a system  are 
normally  associated  with  operation  and  support  (O&S)  (11:4). 

Clearly,  then,  if  the  United  States  is  to  obtain 
the  weapon  systems  and  related  support  equipment  necessary 
to  maintain  a credible  defense  posture  in  light  of  limited 
resources,  the  operation  and  support  costs  associated  with 
these  systems  must  be  minimized  (5:3.28).  "This  can  only 
be  accomplished  through  emphasizing  a proper  balance  among 
the  three  ingredients  of  life  cycle  costs:  development, 
acquisition,  and  operation  and  support  [12:4]." 

Requirement  for  life  cycle  costing.  During  the  past  decade 
there  has  been  an  increased  emphasis  within  DOD  on  the  use 
of  the  life  cycle  costing  concept  in  the  acquisition  of 
weapon  systems.  This  emphasis  is  based  on  the  logical 
argument  that  procurement  decisions  should  consider  not 
only  unit  price  but  also  other  costs  associated  with  the 
item  being  procured,  such  as  the  costs  of  operation,  sup- 
port and  disposal  (9:vi).  DOD  Directive  5000.28  requires 
the  establishment  of  life  cycle  cost  objectives  for  weapon 
system  acquisition  programs.  Tradeoffs  between  system 
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capability,  cost  and  schedules  must  be  evaluated  to  pro- 
vide the  lowest  overall  life  cycle  cost  within  schedule  and 
performance  requirements  (20:3). 


Current  laws  and  procurement  regulations  provide  the 
general  framework  in  which  the  life  cycle  costing  concept 
can  be  applied. 

Title  10,  USC,  Section  2305(C)  states:  "Award  shall 
be  made  ...  to  the  responsible  bidder  whose  bid  . . . 
will  be  the  most  advantageous  to  the  United  States, 
price  and  other  factors  considered."  Furthermore,  ASPR 
3-801.1  states:  "It  is  the  policy  of  the  Department  of 
Defense  to  procure  supplies  from  responsible  sources  at 
fair  and  reasonable  prices  calculated  to  result  in  the 
lowest  ultimate  overall  cost  to  the  Government."  In 
addition,  Comptroller  General  decision  B-151177,  dated 
17  June  1963,  held  that  award  of  contracts  may  be  based 
on  total  cost  considerations  as  long  as  the  factors  to 
be  considered  are  stated  with  sufficient  clarity  [9:1]. 


Life  cycle  cost  models.  The  integration  of  life  cycle  cost 
objectives  into  program  management  decision  making  requires 
the  development  of  tools  which  the  acquisition  team  can  use 
to  determine  initial  estimates  of  total  life  cycle  costs, 
including  operation  and  support  costs.  Tools  are  also 
needed  to  enable  them  to  determine  appropriate  tradeoffs 
among  acquisition  cost,  performance,  scheduling  and  O&S 
costs  (12:4) . 

The  primary  tool  is  the  cost  model,  which  can  be 
defined  as  a systematic  sequence  of  mathematical  relation- 
ships formulating  a cost  methodology  which  utilizes  inputs 
in  the  form  of  equipment  descriptions,  organization,  pro- 
cedures and  other  variables  to  determine  outputs  in  the 
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form  of  cost  estimates  ( 2 2 : p . 3— 1 ) . Cost  models  facilitate 
handling  large-scale,  complex  systems  by  providing  for 
"creative  manipulation  in  order  to  test  new  ideas  concerning 
system  components  and/or  relationships  [7:392]." 

Included  in  the  general  category  of  cost  models  are 
life  cycle  cost  models.  These  can  be  distinguished  from 
other  types  of  cost  models  in  that  they  project  subsequent 
operation  and  support  costs  resulting  from  contemplated 
design  decisions  (22:p.3-2).  To  be  effective,  these  models 
should  meet  the  primary  requirements  of  completeness,  sensi- 
tivity, validity  and  availability  of  input  data.  To  be  com- 
plete, they  must  consider  all  cost  elements  relative  to  the 
decision  issue  at  hand.  They  must  also  be  sensitive  to 
changes  in  design  or  program  variables  so  that  differences 
in  the  costs  of  alternatives  will  be  apparent.  Although 
models  can  only  approximate  the  real-life  situation,  they 
must  be  validated  to  be  of  practical  use  in  decision  making. 
Finally,  in  developing  LCC  models,  one  must  recogniz  any 
limitations  that  exist  with  regard  to  obtaining  accurate 
input  data  (6:24-25). 

Several  deficiencies  have  been  identified  in  exist- 
ing models.  Many  are  insensitive  to  performance  and  design 
variables  such  as  material  type,  dimensions,  accuracy, 
speed  and  range,  making  the  evaluation  of  design  alterna- 
tives very  difficult.  Since  many  models  are  general  in 
nature,  they  tend  to  be  overly  complex  because  of  numerous 
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and  poorly  defined  variables.  Some  frequently  require 
input  data  which  may  not  be  available  in  the  required  time 
frame  or  which  may  not  meet  required  accuracy  (3:8-10). 

Others  may  be  subject  to  statistical  errors  where  statis- 
tically determined  cost  estimating  relationships  are  used 
(19:1).  These  deficiencies  must  be  considered  when  LCC 
models  are  used  as  a basis  for  program  decisions. 

In  addition  to  deficiencies  in  the  models  themselves, 
problems  exist  in  the  implementation  of  life  cycle  cost  tech- 
niques. "Much  effort  remains  before  O&S  costs  can  be  measured 
in  a manner  suitable  for  practical  applications  in  acquisi- 
tion and  logistics  management  [11:4]."  Figure  2.2  compares 
this  problem  to  an  iceberg  in  which  the  majority  of  costs 
are  submerged,  making  them  less  apparent  (2:p.l-36).  In  the 
past,  program  managers  have  focused  their  attention  on  the 
more  visible  procurement  and  R&D  costs  while  neglecting  the 
less  discernible  O&S  costs  (21:2). 

This  "iceberg"  effect  can  be  attributed  to  many  fac- 
tors. Current  techniques  for  predicting  and  verifying  O&S 
costs  are  inadequate  (9:viii).  They  usually  address  only  a 
portion  of  total  O&S  costs  in  that  they  deal  with  logistics 
variables  without  considering  performance  variables.  The 
validity  of  model  outputs  is  often  suspect  due  to  poor  quality 
and  insufficient  input  data,  especially  during  testing. 
Additional  difficulties  may  arise  when  the  various  nomencla- 
tures used  within  different  data  systems  are  considered  (4:11). 
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Summary . Due  to  the  current  budget  crunch  within  DOD, 
increased  emphasis  has  been  placed  on  the  concept  of  life 
cycle  costing.  DOD  Directive  5000.28  requires  the  establish- 
ment of  LCC  objectives  for  weapon  system  acquisition  programs. 
In  order  to  meet  these  objectives,  LCC  models  must  be  devel- 
oped and  applied.  For  these  models  to  be  effective,  they 
should  meet  the  primary  requirements  of  completeness,  sensi- 
tivity, validity  and  availability  of  input  data.  Many  of 
the  existing  models,  however,  are  deficient  in  one  or  more 
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of  these  areas.  Problems  also  exist  in  the  implementation 
of  LCC  techniques. 


Justi fication 

The  Air  Force  Acquisition  Logistics  Division  of  the 
Air  Force  Logistics  Command  (AFLC)  is  in  the  process  of 
developing  a LCC  model  for  the  proposed  Advanced  Medium 
Range  Air-to-Air  Missile  (AMRAAM) . A by-product  of  this 
effort  will  be  a general  model  applicable  to  all  tactical 
missiles.  As  the  basis  for  this  effort,  Ogden  Air  Logistics 
Center  (OO-ALC)  and  Warner  Robins  Air  Logistics  Center 
(WR-ALC)  have  provided  the  LCC  models  applicable  to  the 
tactical  missiles  for  which  they  are  system  managers  (16). 
These  models  exhibit  many  of  the  deficiencies  in  LCC  models 
discussed  previously.  Of  particular  concern  is  the  weakness 
in  accurately  estimating  the  depot  overhaul  cost  of  guidance 
and  control  subsystems,  which  comprises  a major  portion  of 
operation  and  support  costs  (14).  For  example,  a recent 
cost  estimate  for  the  Low  Cost  Lightweight  Missile  (LCLM) 
attributed  approximately  45  percent  of  total  annual  O&S 
costs  to  GCfc  depot  overhaul  (13:1).  These  existing  models 
do  not  predict  GCS  depot  overhaul  costs  but  rather  require 
an  estimate  of  these  costs  as  input  data  (16).  In  the  past, 
the  estimate  was  calculated  simply  as  a percentage  of  missile 
acquisition  cost;  however,  this  estimating  technique  has 
never  been  validated  (14). 
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Since  existing  models  are  dependent  upon  the  accuracy 
of  the  externally  estimated  overhaul  cost,  a valid  and  reli- 
able cost  estimating  technique  is  required  (14).  AFLC/MAX, 
which  is  responsible  for  maintenance  planning  within  AFLC, 
depends  upon  the  Cost  Analysis  Division,  AFLC/ACRC,  for  infor- 
mation concerning  depot  overhaul  costs  (17).  AFLC/ACRC,  in 
turn,  relies  upon  the  ALC  having  item  management  responsi- 
bility for  a particular  subsystem  for  specific  depot  over- 
haul cost  estimates  (8) . As  previously  stated,  WR-ALC,  the 
item  manager  for  the  majority  of  tactical  missile  guidance 
and  control  subsystems,  does  not  possess  a reliable  method 
for  forecasting  the  depot  overhaul  cost  of  these  subsystems 
during  system  development.  A cost  estimating  relationship 
model  would  provide  a useful  tool  for  forecasting  tactical 
missile  GCS  depot  overhaul  cost  (14). 
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Chapter  3 


METHODOLOGY 

The  objectives  of  this  research  were  twofold--to 
identify  the  most  important  variables  for  determining  the 
cost  of  tactical  missile  GCS  depot  overhaul  and  to  use  these 
variables  to  develop  a cost  estimating  relationship  model 
for  forecasting  GCS  depot  overhaul  cost.  Both  of  these 
objectives  were  met  by  using  the  technique  ot  multiple  linear 
regression  (MLR)  since  it  serves  two  primary  functions. 

First,  MLR  provides  a statistical  technique  for  analyzing 
relationsh.ps  between  a single  dependent  variable  and  one  or 
more  independent  variables  (lr->:321).  Second,  it  provides 
means  for  developing  a mathematical  model  which  can  be  used 
to  forecast  the  value  of  the  dependent  variable  based  on  its 
relationships  with  one  or  more  independent  01  predictor 
variables  (18:301),  Standard  computer  subprograms  were  used 
to  facilitate  these  analyses  and  to  provide  the  information 

required  for  evaluating  their  results.  j 

Data  Acquisition  Plan 

A prerequisite  to  performing  a linear  regression  j 

analysis  is  the  acquisition  of  data.  Since  this  research 
was  concerned  with  obtaining  a predictive  capability  during 

j 

system  development,  acquired  data  had  to  be  of  the  type  j 
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which  could  be  identified  and  obtained  prior  to  system 
deployment . 


Population.  The  population  from  which  a sample  of  missiles 
was  drawn  consisted  of  all  present  and  future  anti-radiation, 
infrared  and  semi-active  radar  tactical  missile  guidance 
and  control  subsystems  (GCS)  managed  by  WR-ALC.  Missiles 
of  these  types  currently  in  the  Air  Force  inventory  are  the 
AGM-45A/B1  Shrike,  AGM-78C/D  Standard  ARM,  AIM-9B/E/J/J- l2 
Sidewinder,  AIM-7E2/3S.F4/5/6/7  Sparrow,  and  AIM-4D-8/9&F/G 
Falcon  (23:1).  Others  in  development  or  production  include 
the  AMRAAM,  LCLM,  AGM-88  HARM,  and  AIM-9L  Sidewinder  (14). 

The  population  included  only  the  GCS  associated  with  the 
above  missile  types  since  the  model  was  developed  for  WR-ALC 
use. 

Sample . The  sample  data  used  to  construct  the  cost  model 
consisted  of  the  GCS  for  the  AGM-45,  AIM-7,  and  AIM-9  series 
missiles  which  had  been  depot  overhauled  between  fiscal  years 
1974  and  1977.  The  AGM-78  series  missiles  were  excluded 
from  the  sample  because  no  depot  overhaul  data  was  recorded 
for  this  time  period.  The  AIM-4  series  missiles  were 
excluded  from  the  sample  since  they  are  in  the  process  of 
being  phased  out  and  are  repaired  under  a maintenance  concept 

^AGM  - Air-to-Ground  Missile. 

2 

AIM  - Air  Intercept  Missile. 
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which  is  not  consistent  with  that  of  other  tactical  missiles 
within  the  population.  The  specified  time  frame  was  selected 
to  facilitate  data  collection  and  to  provide  sufficient  data 
to  achieve  a representative  sample. 

Data  description.  The  data  collected  in  the  sample  were 
depot  overhaul  costs,  acquisition  costs  and  numerical  data 
on  selected  physical  characteristics.  Depot  overhaul  costs 
included  the  costs  to  overhaul  either  within  the  Air  Force 
at  WR-ALC  or  OO-ALC  or  under  contract  with  the  Navy  or 
commercial  contractors.  All  in-house  and  commercial  over- 
haul costs  were  obtained  from  the  AFLC  H036B,  DOD  Cost  and 
Production  Report.  The  Navy  overhaul  costs  were  obtained 
from  the  WR-ALC  tactical  missile  production  manager  and  the 
H036B  report,  which  included  interservicing  (Navy)  depot 
overhaul  costs  beginning  with  the  FY7T  report.  It  war 
assumed  that  these  reported  costs  were  accurate  and  that 
errors,  if  any,  were  random.  Since  those  costs  are  actual 
dollar  amounts,  they  are  ratio- level  data.  All  costs  won- 
adjusted  to  constant  FY  1977  dollars  using  a combined  index 
developed  in  Appendix  A. 

Acquisition  costs  included  the  latest  purchase  pt  ice 
for  each  GCS  in  the  sample,  adjusted  to  constant  FY  1977 
dollars  in  accordance  with  the  DOD  Industry  Purchases  Index 
found  in  Table  A.l,  page  59.  These  costs  were  obtained  from 
the  WR-ALC  tactical  missile  system  manager  and  are  also 
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ratio-level  data.  Again,  these  costs  were  assumed  to  be 


accurate . 


Numerical  data  on  selected  physical  characteristics 
for  each  GCS  included: 

1.  Number  of  subassemblies  - the  number  of  major 
reparable  components  of  a GCS,  such  as  the  target  seeker, 
amplifier,  gyro  drive  assembly,  servo,  power  supply  and 
guidance  computer; 

2.  Weight  - the  weight  in  pounds  of  a complete  CCS-5; 

3.  Length  - the  length  in  inches  of  a complete  GCS; 

4.  Diameter  - the  diameter  in  inches  of  a GCS  at 
its  largest  point; 

5.  Volume  - the  volume  in  cubic  inches  of  a complete 


6.  Type  of  guidance  employed  - either  anti-radiation, 
infrared  or  semi-active  radar. 

Performance  characteristics  data  were  classified  and  could 
not  be  used  in  this  research  effort.  All  physical  data  were 
obtained  from  the  WR-ALC  tactical  missile  technical  manager. 
All  of  these  data  are  ratio-level  data  except  for  type  of 
guidance  employed,  which  is  nominal- level  data. 


^A  complete  GCS  includes  all  components  performing 
the  GCS  functions,  whether  or  not  separated  by  any  other 
major  missile  component,  e.g.,  warhead,  but  does  not  include 
that  other  component  nor  wings  and  fins/canards. 
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Developing  the  Model 

The  multiple  linear  regression  technique,  which  was 
used  to  develop  the  GCS  depot  overhaul  cost  forecasting 
model,  is  detailed  in  Appendix  B.  The  general  form  of  a 
MLR  model  is: 

y = bQ  + + b2x2  + . . . + bkxk 

where  y is  the  dependent  variable  and  through  are  the 
independent  variables. 


Identification  of  variables.  The  dependent  variable  is  GCS 
depot  overhaul  cost,  which  is  predicted  by  the  model.  In 
formulating  the  model,  ec.ch  observation  of  the  cost  data 
was  entered  with  the  corresponding  values  of  the  independent 
variables.  The  independent  variables  are  acquisition  cost, 
number  of  subassemblies,  weight,  length,  diameter,  volume, 
density  and  type  of  guidance  employed.  Density  was  not 
input  directly  but  rather  was  computed  within  the  MLR  pro- 
gram (Density  = Weight  7 Volume).  Table  3.1  summarizes 
information  concerning  these  variables.  Appendix  C contains 
all  observed  data  and  describes  its  conversion  to  the  format 
used  for  the  MLR  analysis. 

Since  the  independent  variable  type  of  guidance 
employed  is  nominal-level  data,  it  required  the  use  of 
categorical  variables,  sometimes  referred  to  as  dummy  vari- 
ables. In  the  method  of  differences,  which  is  the  technique 
by  which  nominal- level  data  is  encoded  in  a MLR  model,  one 
type  or  category  is  established  as  the  base  level.  The 
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remaining  categories  are  then  each  defined  by  a categorical 
variable  (10:78).  Two  categorical  variables  were  required 
for  this  model  since  there  are  three  categories  of  guidance 
employed  within  the  population:  anti-radiation,  infrared 
and  semi-active  radar.  Semi-active  radar  was  used  as  the 
base  level  since  it  had  the  fewest  number  of  observations. 

Model  manipulation.  The  AFLC  CREATE  computer  system  was  used 
in  the  development  and  manipulation  of  the  model.  A time- 
sharing file  was  established  containing  all  observations  of 
the  data  under  consideration  (Figure  C.l,  page  77).  The 
multiple  linear  regression  was  accomplished  under  the 
REGRESSION  subprogram  of  the  Statistical  Package  for  the 
Social  Sciences  (SPSS)  system  of  computer  programs  using  the 
time-sharing  CARDIN  subsystem  (15:320-367,373-383). 

Model  evaluation.  The  methodology  described  herein  resulteu 
in  a MLR  model,  which  was  the  primary  objective  of  this 
research.  For  the  MLR  model  to  be  utilized  as  a predictor 
of  GCS  depot  overhaul  costs,  it  was  necessary  to  evaluate  it 
in  terms  of  its  statistical  significance.  The  first  step  in 
this  evaluation  was  to  calculate  the  coefficient  of  deter- 
mination, which  measures  the  relative  efficiency  with  which 

I 

the  independent  variables  can  be  used  to  forecast  a value  of 
the  dependent  variable,  GCS  depot  overhaul  cost.  The  second 
was  to  determine  the  significance  of  overall  regression, 
which  indicates  the  level  of  confidence  at  which  the  model 
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is  statistically  significant.  The  third  step  was  to  deter- 
mine the  statistical  significance  of  each  of  the  independent 
variables  in  order  to  determine  whether  each  variable  should 
remain  in  the  model.  This  evaluation  process  is  described 
further  in  Appendix  B. 

Assumptions 

Pertinent  assumptions  made  for  this  research  were  as 

follows : 

1.  The  basic  assumptions  of  MLR,  as  enumerated  in 
Appendix  B were  applicable. 

2.  All  data  were  assumed  to  be  accurate. 

3.  The  labor/material  breakout  for  AIM-9  depot  over- 
haul was  representative  of  all  missiles  in  the  sample 
(Appendix  A) . 

4.  The  indices  contained  in  Appendix  A were  repre- 
sentative of  the  inflation  experienced  for  missile  acquisi- 
tion and  depot  overhaul  costs. 

Limitations 

Basic  limitations  on  this  research  were  as  follows: 

1.  The  population  was  limited  to  tactical  missile 
GCS  managed  by  WR-ALC. 

2.  The  independent  variables  were  limited  to  those 
for  which  data  were  unclassified. 

3.  The  independent  variables  were  limited  to  those 
which  can  be  quantified  during  system  development. 
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Chapter  4 

ANALYSIS 

Selecting  Individual  Variables 

The  first  objective  of  this  research  was  to  iden- 
tify the  most  important  variables  which  could  be  used  for 
determining  the  cost  of  tactical  missile  GCS  depot  overhaul. 
The  initial  step  in  achieving  this  objective  was  to  examine 
the  correlation  coefficient  of  each  independent  variable  with 
respect  to  the  dependent  variable,  depot  overhaul  cost  (OHC) . 
Next,  a linear  regression  was  performed  for  OHC  with  each 
independent  variable.  The  residual  plots  and  other  infor- 
mation gained  from  these  regressions  were  then  examined  as 
the  final  step  in  meeting  the  first  objective  and  provided 
the  basis  for  further  analysis. 

Correlation . Table  4.1  lists  the  coefficients  of  correla- 
tion between  OHC  and  each  of  the  independent  variable-;.  The 
figures  indicate  that  the  highest  correlations  exist  between 
the  dependent  variable,  OHC,  and  the  four  independent  vari- 
ables acquisition  cost  (AC) , weight  (WT) , length  (LH)  and 
volume  (VO).  Number  of  subassemblies  (NS)  and  diameter  (DI) 
exhibited  lesser  correlations.  For  this  reason  and  reasons 
set  forth  in  the  following  paragraph,  the  latter  two  vari- 
ables were  determined  not  to  be  important.  Although  its 
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correlation  was  low,  density  (DN)  was  subjected  to  further 
analysis,  as  described  later,  and  found  to  be  an  important 
variable.  The  correlations  for  the  individual  categorical 
variables,  TGI  and  TG2 , are  meaningless  since  together  they 
represent  a single  independent  variable  and  must  be  con- 
sidered as  such. 


Table  4 . 1 

OHC  Correlation  Coefficients 


Independent 

Variable 

Correlation 
Coefficient  (R) 

AC 

0.82686 

NS 

-0.71235 

WT 

0.82301 

LH 

0.83035 

DI 

0.55994 

VO 

0.81788 

TGI 

-0.55994 

TG2 

-0.16001 

DN 

-0.6672R 

Type  of  Guidance  Employed  (TG) . In  order  to  determine  the 
relationship  between  OHC  and  TG,  a linear  regression  of  OHC 
with  TGI  and  TG2  was  performed.  The  resultant  correlation 
coefficient  was  0.86124.  This  coefficient,  higher  than  any 
other  individual  correlation  coefficient,  indicates  the 
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importance  of  this  categorical  variable  for  determining  the 
cost  of  CCS  depot  overhaul.  It  was  found  that  TGI  was 
perfectly  inversely  correlated  (R  = -1.0)  with  DI.  Also, 

TG  (TGI  and  TG2  in  combination)  exhibited  a similar  rela- 
tionship with  NS.  When  TGI  and  TG2  both  equal  zero  (semi- 
active radar),  NS  equals  two;  when  TGI  = 1 and  TG2  = 0 
(infrared),  NS  = 5;  when  TGI  = 0 and  TG2  = 1 (anti- 
radiation), NS  = 3.  Therefore,  when  TGI  and  TG2  are  used 
in  combination,  they  provide  not  only  information  on  type  of 
guidance  but  also  information  on  number  of  subassemblies  and 
diameter  as  well,  making  the  independent  variables  NS  and  DI 
unnecessary. 

Acquisition  Cost  (AC) . A simple  linear  regression  of  OHC 

with  AC  confirmed  the  importance  of  this  independent  variable. 

2 

The  relative  efficiency  (R  ) was  0.68371,  and  was  found  to  be 
significant  at  a confidence  level  greater  than  99.9  percent 

(F0  * 58'36  > F. 001,1. 27  ■ 13-61'4- 

Weight  (WT) . In  the  simple  linear  regression  of  OHC  with 
WT,  the  relative  efficiency  was  0.67735,  and  was  found  to  be 
significant  at  a confidence  level  greater  than  99.9  percent 

,F0  * 56-68  > F. 001 , 1 , 27  ■ 13-61>- 

Length  (LH) . Similarly,  the  simple  linear  regression  of  OHC 
with  LH  indicated  the  significance  of  this  independent 

4 

See  Appendix  B for  explanation  of  notation. 
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variable.  The  relative  efficiency  was  0.68948.  and  was 
found  to  be  significant  at  a confidence  level  greater  than 
99.9  percent  (FQ  = 59.95  > F gg^.^  27  * 13.61). 

Volume  (VO) . A simple  linear  regression  of  OHC  with  VO 
resulted  in  a relative  efficiency  of  0.66894.  The  relation- 
ship was  significant  at  a confidence  level  greater  than 
99.9  percent  (F0  = 54.56  > F 001.1  27  = 13.61). 

Plots  of  standardized  residuals.  An  examination  of  the  plots 
of  standardized  residuals  associated  with  each  of  the  vari- 
ables AC,  WT,  LH  and  VO,  Figures  4. 1-4. 4,  gave  no  indication 
that  the  basic  assumptions  of  linear  regression  were  vio- 
lated. Appendix  B provides  information  regarding  the 
examination  of  residual  plots. 

Density  (DN) . A simple  linear  regression  of  OHC  with  DN 
produced  a relative  efficiency  of  0.44527.  An  examination 
of  the  plot  of  standardized  residuals,  Figure  4.5,  revealed 
that  the  basic  linear  regression  assumption  that  the  expec- 
ted value  of  the  error  term  for  any  given  observation  equals 
zero  was  violated.  It  also  revealed  the  possibility  of  a 
curvilinear  relationship.  In  order  to  explore  this  possi- 
bility, a multiple  linear  regression  of  OHC  with  DN  and  DN 
squared  (DNS)  was  performed.  This  resulted  in  a relative 
efficiency  of  0.68472,  and  a corresponding  correlation 

coefficient  of  0.82748  between  OHC  and  the  combination  of 

2 

DN  and  DNS.  The  R value  was  significant  at  a confidence 
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Figure  4.2 

Residual  Plot  for  WT 
26 


Figure  4.4 

Residual  Plot  for  VO 
28 


9.12).  In  the  plot  of  standardized  residuals,  Figure  4.6, 
when  DN  and  DNS  were  used  in  combination,  the  individual 
observations  appeared  to  be  randomly  scattered. 

Summary.  Based  on  an  analysis  of  correlation  coefficients 
and  individual  regressions,  the  independent  variables  listed 
in  Table  4.2  were  identified  as  the  most  important  variables 
for  determining  the  cost  of  tactical  missile  CCS  depot  over- 
haul. These  variables  were  the  basis  for  developing  the 
cost  estimating  relationship  model  for  forecasting  CCS  depot 
overhaul  costs,  the  second  objective  of  this  research. 


Table  4.2 

Important  Variables 


Variable 

Correlation 

Coefficient 

R2 

TG1/TG2 

0.86124 

0.74174 

LH 

0.83035 

0.68948 

DN/DNS 

0.82748 

0.68472 

AC 

0.82686 

0.68371 

WT 

0.82301 

0.67735 

VO 

0.81788 

0.66894 

Combinations  of  Variables 

To  meet  the  second  research  objective,  multiple 
linear  regressions  were  developed  using  various  combinations 
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of  the  independent  variables  previously  determined  to  be 
significant.  The  first  combination  of  variables  used  was 
Acquisition  Cost  and  Type  of  Guidance  Employed,  since  these 
are  the  factors  which  have  been  used  in  the  past  to  estimate 
CCS  depot  overhaul  cost.  Other  combinations  were  then  used 
to  develop  the  best  possible  cost  estimating  relationship 
mo'del  from  the  available  data. 

Acquisition  Cost  and  Type  of  Guidance  Employed.  A multiple 
linear  regression  of  OHC  with  AC,  TGI  and  TG2  was  performed. 
This  regression  called  for  the  simultaneous  inclusion  of  the 
three  independent  variables.  The  following  MLR  model  was 
developed : 

OHC  = 2,278.06853  + 0.02722AC 

- 1,220. 49163TG1  - 1 , 374 . 844 10TG2 . 

2 

The  relative  efficiency  (R  ) for  this  model  was  0.84565.  The 
test  for  overall  model  significance  showed  that  the  model  was 
significant  at  a confidence  level  greater  than  99.9  percent: 

F0  = 45,66  51  F.  001 ; 3 , 25  = 7-45- 
The  simultaneous  tests  of  significance  of  the  individual 

regressors  showed  that  their  coefficients  were  each  signifi- 
cantly different  from  zero  at  a confidence  level  qreater 
than  99.7  percent: 


(AC) 

Fq  = 16.83 

> F nn,/i  i u = 13.88 
#003/3*  1 > 2 5 

(TGI) 

FQ  = 16.28 

> F = 13.88 

. 003/3 ; 1 t 25 

(TG2) 

Fq  = 26.07 

> F = 13.88 

.003/3# 1 9 25 
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An  examination  of  the  plot  of  standardized  residuals. 

Figure  4.7,  gave  no  indication  that  the  basic  assumptions  of 
linear  regression  were  violated. 


Stepwise  inclusion  of  all  variables.  A stepwise  regression 
of  OH C with  all  independent  variables  except  DNS  was  per- 
formed. The  regression  brought  in  the  six  variables,  LH, 
AC,  WT,  VO,  DN  and  TG2 , in  the  order  listed.  After  the 
inclusion  of  WT,  step  number  three,  little  improvement  in 
the  model  was  achieved  through  the  inclusion  of  additional 

2 

variables.  VO,  brought  in  on  the  fourth  step,  increased  R 
by  only  .00156.  Further,  its  coefficient  was  not  signifi- 
cant even  at  a 50  percent  confidence  level: 


F0  = 0,39  < F.5;l,24  *47‘ 

The  extremely  low  significance  level  of  VO  and  the  lower 
significance  level  of  the  remaining  variables  were  due  to 
the  intercorrelation  among  the  independent  variables,  as 
shown  in  Table  4.3.  Consequently,  the  model  as  developed  at 
step  three  was  subjected  to  further  analysis.  This  model 
was  as  follows: 


OHC  = -794.75599  + 134.90826LH  + 0.04405AC  - 54.63667WT. 

2 

An  R value  of  0.90121  was  achieved  by  this  model.  The  test 
for  overall  model  significance  showed  that  it  was  significant 
at  a confidence  level  greater  than  99.9  percent: 


F0  ~ 76'02  > F.ooi;3,25  = 7-45- 
The  simultaneous  tests  of  significance  of  the 

regressors  showed  that  their  coefficients  were 


individual 

each 
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significantly  different  from  zero  at  a confidence  level 
greater  than  99.7  percent: 


(LH) 

FQ  = 28.93 

> F.003/3;l,25  = 13‘88 

(AC) 

FQ  = 53.55 

> F.  00  3/3 ; 1 , 25  = 13,88 

(WT) 

Fq  = 19.79 

> F. 003/3:1, 25  = 13,88 

An  examination  of  the  plot  of  standardized  residuals.  Figure 
4.8,  gave  no  indication  that  the  basic  assumptions  of  linear 
regression  were  violated. 


Stepwise  inclusion  of  physical  variables.  A stepwise 
regression  was  performed  using  only  the  independent  variables 
associated  with  physical  characteristics  of  the  GCS.  These 
included  NS,  WT,  LH,  DI,  VO  and  DN . The  regression  brought 
in  all  variables  except  NS,  in  the  following  order:  LH,  DN , 
WT,  VO,  DI.  Upon  completion  of  the  fifth  and  final  step, 
all  variables  included  were  significant  at  a confidence  level 
greater  than  97.5  percent,  as  demonstrated  by  the  simultan- 
eous test  of  individual  regressor  significance: 


b (LH) 

F0 

= 13.60 

> 

F. 025/5;l, 23  = 9-63 

(97.5%) 

b (DN) 

F0 

= 11.58 

> 

F. 025/5 ; 1 , 2 3 = 9,63 

(97.5%) 

b (WT) 

Fo 

= 20.27 

> 

F. 005/5:1, 23  = 14' 19 

(99.5%) 

b(vo) 

Fo 

= 16.49 

> 

F. 005/5:1, 23  = 14,19 

(99.5%) 

b (DI ) 

Fo 

= 15.14 

> 

F. 005/5:1, 23  = 14,19 

(99.5%) 

The  resultant  model  was  as  follows: 

OHC  = 34,393.21697  + 516.81280LH  - 409 . 51 1 . 2178 3DN 
+ 477. 69390WT  - 28.53265VO  - 3 . 646 . 9 359 3DI . 
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The  R for  this  model  was  0.86068,  and  the  test  for  overall 
model  significance  showed  that  the  model  was  significant  at 
a confidence  level  greater  than  99.9  percent: 


F0  - 28-42  > F . 001 ; 5 , 23  = 6*08- 


An  examination  of  the  plot  of  standardized  residuals,  Figure 
4.9,  gave  no  indication  that  the  basic  assumptions  of  linear 
regression  were  violated. 


Stepwise  inclusion  of  selected  variables  after  fo reed 
inclusion  of  categorical  variables.  A hierarchical  type 
regression  was  performed  using  OHC  with  all  independent 
variables  except  DNS.  The  regression  forced  the  inclusion 
of  the  categorical  variables,  TGI  and  TG2,  on  the  initial 
step,  followed  by  the  stepwise  inclusion  of  the  remaining 
variables.  This  hierarchical  method  was  used  because  of  the 
increased  information  provided  by  the  inclusion  of  TGI  and 
TG2  in  combination.  The  stepwise  regression  brought  in  the 
additional  variables  VO,  LH,  AC  and  DN,  in  the  order  listed. 
After  the  inclusion  of  LH,  step  number  three,  little  improve- 


ment in  the  model  was  achieved  through  further  iterations. 

.2 


AC,  brought  in  on  the  fourth  step,  increased  R by  only 
0.00036.  Further,  its  coefficient  was  not  significant  even 
at  a 50  percent  confidence  level: 


F.  = 0.08  < F _ = .47. 

0 • 5 i 1 f 2 3 


Due  to  the  extremely  low  significance  level  of  AC  and  the 
lower  significance  level  of  DN,  the  model  as  developed  at 
step  three  was  subjected  to  further  analysis.  This  model 
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was  as  follows: 


OHC  = 16,148.20523  - 14 , 855 . 44 389TG1 

- 11,128.03253TG2  - 5.92152VO  + 89.20825LH. 


The  R for  this  model  was  0.90215,  and  the  test  for  overall 
model  significance  showed  that  the  model  was  significant  at 
a confidence  level  greater  than  99.9  percent: 

F0  * 55-32  > F. 00! ; 4 , 24  = 6'59- 
The  simultaneous  tests  of  significance  of  the  individual 

regressors  showed  that  their  coefficients  were  each  signifi- 
cantly different  from  zero  at  a confidence  level  greater  than 
96  percent: 


b (TGI) 

Fo 

47.36  > F ' 004/4 ; 1 , 24 

= 14.03 

(99.6%) 

b (TG2) 

Fo 

49.50  > F_  004/4 ; 1 , 24 

= 14.03 

(99.6%) 

b(vo) 

Fo 

37.70  > F . 004/4 ; 1 , 24 

= 14.03 

(99.6%) 

b(LH) 

Fo 

9.23  > F. 04/4, -1,24 

7 . 82 

(96%) 

An  examination  of  the  plot  of  standardized  residuals.  Figure 
4.10,  gave  no  indication  that  the  basic  assumptions  of  linear 
regression  were  violated. 


Stepwise  inclusion  of  selected  variables  after  forced 
inclusion  of  density  variables.  Several  regression  programs 
were  run  forcing  the  inclusion  of  the  variables  DN  and  DNS 
in  combination.  This  technique  was  used  because  of  the 
previously  determined  curvilinear  relationship  between  over- 
haul cost  and  density.  The  best  model  obtained  through  this 
technique  resulted  when  the  variables  DN  and  DNS  were  included 
on  the  initial  step,  followed  by  the  stepwise  inclusion  of 
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all  the  remaining  variables.  The  stepwise  regression 
brought  in  the  additional  variables  AC,  LH,  WT  and  VO,  in 
the  order  listed.  After  the  inclusion  of  AC,  step  number 
two,  little  improvement  in  the  model  was  achieved  through 

further  iterations.  LH,  brought  in  on  the  third  step, 

2 ... 
increased  R by  only  0.00301.  Further,  its  coefficient  was 

not  significant  at  an  80  percent  confidence  level: 

F0  = °-63  * F.  2 ; 1 , 24  = 1’  74> 


In  addition,  the  inclusion  of  LH  reduced  the  significance  of 
both  DN  and  DNS  to  a confidence  level  below  50  percent 
because  LH  was  more  highly  correlated  with  OHC  and  because 
of  the  intercorrelations  between  LH  and  both  DN  and  DNS. 

Due  to  the  low  significance  level  of  LH  and  its  effect  on 
DN  and  DNS,  as  well  as  the  lower  significance  level  of  WT 
and  VO,  the  model  as  developed  at  step  two  was  subjected  to 
further  analysis.  This  model  was  as  follows: 

OHC  = 11,948.00773  + 2 , 352 , 229 . 76527DN2 
- 327 , 399. 14858DN  + 0.03390AC. 

2 

An  R value  of  0.88245  was  achieved  by  this  model.  The 
test  for  overall  model  significance  showed  that  the  model 
was  significant  at  a confidence  level  greater  than  99.9 
percent : 


F0  “ 62,56  > F. 001;3,25  ~ 7,45> 

The  simultaneous  test  of  significance  of  the  individual 

regressors  showed  that  their  coefficients  were  each  signifi- 
cantly different  from  zero  at  a confidence  level  greater  than 
99.7  percent: 
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(DNS) 

Fq  = 37.79 

F. 003/3; 1 , 25  = 1J-88 

(DN) 

Fq  = 40.23 

F. 003/3; 1 , 25  = 13,88 

(AC) 

FQ  = 42.05 

> F. 003/3; 1,25  = 13-88- 

An  examination  of  the  plot  of  standardized  residuals,  Figure 
4.11,  gave  no  indication  that  the  basic  assumptions  of 
linear  regression  were  violated. 

In  this  and  other  programs  which  forced  the  inclu- 
sion of  DN  and  DNS  in  combination,  the  inclusion  of  variables 
other  than  AC  resulted  in  a substantial  reduction  in  the 
significance  of  DN  and/or  DNS  within  the  model.  This  reduc- 
tion was  due  to  the  high  intercorrelation  between  density 
and  the  other  physical  characteristics  which  were  examined. 

Summary . Five  different  models  were  developed  from  the 

multiple  linear  regression  analyses  performed.  These  models, 

2 

along  with  their  corresponding  R and  F values  are  listed  in 
Table  4.4.  These  models  were  subjected  to  further  evalua- 
tion to  determine  the  best  model (s)  for  forecasting  GCS  uepot 
overhaul  cost. 

Subjective  Evaluation 

The  four  primary  requirements  of  life  cycle  cost 
models  listed  in  Chapter  2 are  completeness,  sensitivity, 
validity  and  availability  of  input  data.  The  last  three  are 
also  applicable  to  the  cost  estimating  relationship  model 
developed  herein.  The  first  requirement,  completeness,  per- 
tains only  to  cost  accounting  models,  such  as  LCC  models, 
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which  must  consider  all  relevant  cost  elements.  A cost 
estimating  relationship  model  addresses  only  a single  cost 
element,  which  in  this  case  is  GCS  depot  overhaul  cost. 

Sensitivity . A model  must  be  sensitive  to  changes  in  design 
variables  so  that  differences  in  the  overhaul  costs  of  alter- 
native GCS  configurations  will  be  apparent.  The  physical 
variables  in  the  models  listed  in  Table  4.2,  length,  weight, 
volume,  diameter,  density  and  type  of  guidance  employed,  are 
all  design  variables  which  could  logically  impact  on  GCS 
depot  overhaul  cost.  The  remaining  variable  contained  in 
the  models,  acquisition  cost,  can  be  considered  a design 
constraint,  as  in  "design  to  cost."  As  opposed  to  that  of 
the  design  variables,  the  relationship  of  acquisition  cost 
to  overhaul  cost  is  indirect.  When  set  at  a specified 
level,  acquisition  cost  acts  as  a constraint  upon  the  design 
variables,  both  physical  and  performance,  which  in  turn 
affect  overhaul  cost. 

Design  variables  concerning  performance  character- 
istics were  not  used  in  the  development  of  the  models. 
Therefore,  the  sensitivity  of  these  models  to  changes  in 
performance  characteristics  cannot  be  determined.  Some 
possibly  important  performance  variables  include  maximum 
lock-on  range,  guidance  miss-distance,  maximum  "g"  capa- 
bility (maneuverability)  and  of f-boresight  capability.  As 
previously  discussed,  performance  variables  were  excluded 
from  this  research  due  to  their  classified  nature. 
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Validity.  A model  must  be  validated  to  be  of  practical  use 
in  decision  making.  The  models  were  va' idated  statistically 


! ‘ 


but  not  empirically  because  all  the  available  data  were 
required  to  develop  the  models.  Although  there  were  29 
total  data  points,  they  represented  only  eight  different  GCS 
configurations,  as  shown  in  Table  C.l,  page  70. 

Availability  of  input  data.  A model  can  be  useful  only  if 
accurate  input  data  is  available.  This  requirement  is 
particularly  important  for  the  model  developed  herein 
because  it  is  intended  for  use  during  missile  system  devel- 
opment. Accurate  data  for  the  independent  variables 
included  in  the  models  listed  in  Table  4.4  can  be  readily 
obtained  during  system  development  except  for  acquisition 
cost.  Acquisition  cost  is  difficult  to  project  accurately 
because  it  varies  considerably  with  learning  curve,  pro- 
duction quantity,  delivery  schedule  and  the  marketplace. 
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Chapter  5 

SUMMARY  AND  CONCLUSIONS 


Summary 

The  development  of  new  air  launched  tactical  guided 
missiles  is  a continuing  process  within  the  U.S.  Air  Force. 
Recently,  increased  emphasis  has  been  placed  on  designing 
systems  for  supportability  due  to  the  significant  impact  of 
support  costs  on  the  total  life  cycle  cost  of  the  system. 

One  of  the  most  important  contributors  to  tactical  missile 
support  costs  is  the  cost  of  depot  overhaul  of  guidance  and 
control  subsystems.  Despite  its  importance,  depot  overhaul 
costs  are  not  currently  forecast  by  the  operations  and  sup- 
port cost  model  used  by  WR-ALC,  the  system  manager  for 
tactical  missiles.  Instead,  the  model  requires  an  externally 
derived  estimate  of  this  cost  as  input  data.  However, 
accurate  estimating  techniques  have  not  been  developed  to 
forecast  the  cost  of  tactical  missile  guidance  and  control 
subsystems  depot  overhaul  during  system  development. 

In  order  to  solve  this  problem,  two  objectives  were 
established.  The  first  objective  was  to  identify  the  most 
important  variables  for  determining  the  cost  of  tactical 
missile  GCS  depot  overhaul.  The  second  objective  was  to  use 
the  variables  to  develop  a cost  estimating  relationship  model 
which  could  be  used  during  tactical  missile  system  development 
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for  forecasting  GCS  depot  overhaul  cost.  Both  of  these 
objectives  were  met  by  using  the  technique  of  multiple 
linear  regression  with  cost  and  design  data  obtained  from 
the  AFLC  H036B  report  and  WR-ALC.  Data  consisted  of  overhaul 
cost,  acquisition  cost,  number  of  subassemblies,  weight, 
length,  diameter,  volume  and  type  of  guidance  employed  with 
respect  to  the  GCS  for  the  AGM-45,  AIM-7  and  AIM-9  series 
missiles.  Performance  data  were  omitted  because  of  their 
classified  nature. 

Conclusions 

The  analysis  of  the  above  data  provided  the  infor- 
mation needed  to  answer  the  two  basic  research  questions: 

1.  What  variables  are  important  in  determining  the 
cost  of  tactical  missile  GCS  depot  overhaul? 

2.  What  cost  estimating  relationships  would  be 
useful  in  forecasting  GCS  depot  overhaul  cost  during  tactical 
missile  system  development? 


1 

> 
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Research  question  #1.  Based  on  the  analysis  of  correlation 
coefficients  and  regression  models  associated  with  individual 
variables,  the  independent  variables  listed  in  Table  5.1 
were  identified  as  the  most  important  of  all  the  variables 
considered  for  determining  the  cost  of  tactical  missile  GCS 
depot  overhaul.  The  variable  density  exhibited  a curvilinear 
relationship  with  OHC,  requiring  the  addition  of  a density 
squared  factor.  These  variables  were  the  basis  for  developing 


I 


49 


the  cost  estimating  relationship  models  required  to  answer 
the  second  research  question. 


Table  5.1 

Important  Variables 


Variable 

Correlation 

Coefficient 

R2 

Type  of  Guidance 

(TG1/TG2 ) 

0.86124 

0.74174 

Length  (LH) 

0.83035 

0.68948 

Density  (DN/DNS) 

0.82748 

0.68472 

Acquisition  Cost 

(AC) 

0.82686 

0.68371 

Weight  (WT) 

0.82301 

0.67735 

Volume  (VO) 

0.81788 

0.66894 

Research  question  #2.  The  five  models  developed  from  the 

multiple  linear  regression  analyses  are  listed  in  Table  5.2. 

The  models  were  evaluated  in  terms  of  their  relative  eili- 
2 

ciency  (R  ) , overall  significance  (F) , individual  regressor 
significance  and  standardized  residual  plots.  Each  model 
had  a relative  efficiency  in  excess  of  0.8  and  was  signifi- 
cant at  a confidence  level  greater  than  99.9  percent.  The 

2 

actual  values  for  R and  F are  also  contained  in  Table  5.2. 
The  individual  regression  coefficients  ( b ^ ) within  each 
model  were  significant  at  a confidence  level  greater  than  96 
percent.  Finally,  the  examination  of  each  model's  stand- 
ardized residual  plot,  Figures  4.7-4.11,  pages  34,  37,  39, 
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41  and  44,  gave  no  indication  that  the  basic  assumptions  of 
linear  regression  were  violated. 

In  addition  to  these  statistical  evaluations,  sub- 
jective analyses  were  performed  on  each  model  with  respect  to 
sensitivity,  validity  and  availability  of  input  data.  The 
models  were  found  to  be  sensitive  to  physical  design  vari- 
ables, but  no  determination  could  be  made  regarding  their 
sensitivity  to  performance  design  variables  such  as  lock-on 
range  and  guidance  miss-distance. 

Although  the  models  were  validated  statistically,  no 
empirical  validation  was  performed  due  to  the  limited  number 
of  data  observations.  With  regard  to  the  availability  of 
input  data,  it  was  found  that  data  for  all  independent 
variables  except  acquisition  cost  could  be  accurately  esti- 
mated during  missile  system  development.  Accordingly, 
acquisition  cost  was  not  considered  to  be  a desirable  pre- 
dictor variable. 

Based  on  the  considerations  given  above,  the  follow- 
ing model  was  determined  to  be  the  most  useful  in  forecasting 
GCS  depot  overhaul  cost  during  tactical  missile  system 
development : 

OHC  = 16,148.21  - 14,855. 44TG1  - 11,128.03TG2 
- 5 . 9 2 VO  + 89.21LH. 

Three  of  the  other  models  were  eliminated  because  they  each 

contained  acquisition  cost  as  an  independent  variable.  The 

2 

other  model  was  eliminated  because  its  R and  F values  were 


52 


lower  than  those  of  the  selected  model,  and  an  additional 
design  variable,  weight,  would  have  to  be  estimated.  The 
model  selected  requires  estimates  for  only  volume  and  length. 
The  values  for  TGI  and  TG2  do  not  require  estimation  since 
type  of  guidance  is  known  from  the  onset  of  tactical  missile 
system  development. 

Using  the  model.  The  selected  model  is  intended  to  provide 
an  estimate  of  GCS  depot  overhaul  cost  to  be  used  as  input 
data  for  the  WR-ALC  O&S  cost  model  for  tactical  missiles. 

The  following  procedures  apply  when  using  the  model: 

1.  Encode  information  pertaining  to  the  type  of 
guidance  employed. 

a.  If  infrared,  TGI  = 1 and  TG2  = 0. 

b.  If  anti-radiation,  TGI  = 0 and  TG2  = 1. 

c.  If  semi-active  radar,  TGI  = 0 and  TG2  = 0. 

2.  Determine  the  length  (LH)  and  volume  (VO)  in 
inches  of  the  GCS  from  design  drawings  or  specifications. 
These  values  should  be  based  on  external  dimensions.  The 
GCS  includes  all  components  performing  the  guidance  and  con- 
trol functions,  whether  or  not  separated  by  any  other  major 
missile  component,  such  as  the  warhead,  but  does  not  include 
that  component  nor  wings  and  fins/canards. 

3.  Enter  values  for  TGI,  TG2,  LH  and  VO  and  compute 
GCS  overhaul  cost  (OHC) . 


53 


I Wh I "■mniii 


T 


4.  Convert  computed  OHC  value  to  desired  fiscal 
year  dollars  with  an  appropriate  index  of  projected  infla- 
tion. 

The  49.4/50.6  percent  breakout  between  labor  and  material 
(as  developed  in  Appendix  A)  can  be  used  to  establish  a 
combined  index  for  this  purpose. 

These  procedures  can  be  demonstrated  usiny  as  an 
example  the  AIM-7F  GCS,  which  was  included  in  the  sample 
selected  for  this  research.  The  AIM-7F  GCS  employs  semi- 
active radar  guidance;  therefore,  TGI  = 0 and  TG2  - 0. 

Based  on  Table  C.7,  page  76,  LH  = 67.5  and  VO  = 2926.  Sub- 
stituting these  values  into  the  model  as  follows: 

OHC  = 16,148.21  - 14,855.44(0)  - 11,128.03(0) 

- 5.92 (2926)  + 89.21(67.5) ; 

the  computed  value  for  OHC  is  $4848  (in  FY77  dollars). 

This  model  enables  its  user  to  forecast  GCS  depot 
overhaul  cost  with  a few  easily  estimated  physical  parameters 
and  relatively  simple  computations.  This  procedure,  however, 
provides  information  which,  when  input  into  the  WR-ALC  cost 
model,  may  account  for  as  much  as  80  percent  of  l.hc,  total 
annual  O&S  cost  associated  with  a tactical  missile. 

Recommendations . As  previously  mentioned,  no  empirical 
validation  was  performed  on  this  model.  It  is  therefore 
recommended  that  a validation  study  be  conducted  using 
missile  systems  currently  in  development  or  initial 
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production.  Possible  candidates  for  validation  include 
the  AIM-7F  and  AIM-9L. 

Although  performance  characteristics  were  excluded 
from  this  research  because  of  their  classified  nature,  they 
may  be  important  in  forecasting  GCS  depot  overhaul  cost. 
Therefore,  a classified  study  should  be  conducted  to 
determine  which  performance  variables  are  important  and  to 
expand  the  model  accordingly.  The  expansion  of  the  model 
would  entail  additional  regression  analyses  using  the 
variables  identified  by  this  research  (Table  5.1,  page  50) 
along  with  the  desired  performance  variables.  Some  possible 
performance  variables  to  consider  are  lock-on  range,  guid- 
ance miss-distance,  maximum  "q"  capability  (maneuverability) 
and  of f-boresight  capability. 
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In  order  to  perform  the  regression  analyses  it  was 
necessary  to  adjust  all  cost  data,  both  acquisition  and  over- 
haul costs,  to  a common  base,  which  for  this  research  was 
FY  1977.  This  adjustment  was  based  on  the  DOD  indices  con- 
tained in  the  OASD  (Comptroller)  National  Defense  Budget 
Estimates  for  FY  1977,  from  which  Table  A.l  was  extracted. 

It  was  assumed  that  these  indices  were  representative  of  the 
inflation  experienced  for  missile  acquisition  and  depot  over- 
haul costs.  The  Industry  Purchases  Index  shown  in  this  table 
was  used  to  adjust  acquisition  cost  data. 

Depot,  overhaul  costs  included  both  labor  and  material 
costs;  consequently,  a combined  index  was  required.  To 
develop  this  index  the  overhaul  cost  data  were  analyzed  to 
determine  the  percentage  breakout  of  civilian  labor  and 
material  costs.  The  only  data  for  which  this  breakout  was 
available  were  the  costs  for  overhaul  conducted  in-house  on 
AIM-9  missiles.  It  was  assumed  that  this  breakout  was  repre- 
sentative of  all  missiles  within  the  sample.  The  total 
civilian  labor  costs  and  direct  material  costs  for  FY  1974- 
FY  1977  for  AIM-9  GCS  in-house  depot  overhaul  were  $3,695,450 
and  $3,783,81 2,  respectively.  These  costs  represent  a 
breakout  of  49.4  percent  for  labor  and  50.6  percent  for 
materials . 


Table  A.l 


DOD  Indices 

(Base  Year:  FY  1977  = 100) 


FY 

Industry  Purchases 

Composite  Civil 
Service  Pay 

1965 

49.6 

47.4 

1966 

50.3 

48.7 

1967 

51.5 

50.4 

1968 

53.3 

52.3 

1969 

54.8 

55.5 

1970 

57.6 

61.7 

1971 

61.1 

66.1 

1972 

63.3 

70.8 

1973 

66.0 

74.7 

1974 

73.5 

80.0 

1975 

86.2 

86.6 

1976 

92.4 

93.1 

19  7T 

96.9 

96.3 

1977 

100.0 

100.0 

Source:  National  Defense  Budget  Estimates  for 

FY  1977,  OASD  (Comptroller) 


A combined  index  for  each  fiscal  year  was  calculated 
by  multiplying  the  appropriate  index  number  from  Table  A.l 
by  its  appropriate  breakout  percentage  and  summing  these 
weighted  partial  indices.  The  resultant  combined  indices 
are  contained  in  Table  A. 2 below. 


Table  A. 2 

Overhaul  Cost  Indices 
(Base  Year:  FY  1977  = 100) 
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7.  Observational  errors  are  associated  with  the 
dependent  variable  only  (10:12,89). 

The  estimator  of  the  population  regression  model  is: 

y = b0  + b1x1  + b2x2  + . . . + bkxk 

which  in  the  least  squares  method^  is  derived  from  the 
system  of  normal  equations,  which  are  defined  by: 

9(Zei)  0 j = 0,1,.  . . ,k  (10:54,55). 

3b. 

3 

Model  Development  and  Evaluation 

The  SPSS  REGRESSION  subprogram,  which  was  used  to 
develop  the  model,  offers  the  option  of  forward  (stepwise) 
inclusion.  This  option  provides  for  the  isolation  of  a 
subset  of  the  independent  variables  which  yields  an  optimal 
MLR  equation  containing  the  fewest  possible  terms.  The  order 
in  which  independent  variables  are  included  in  the  equation 
is  determined  by  their  respective  contribution  to  the  explan- 
atory power  of  the  model  based  on  specified  minimum  inclu- 
sion criteria.  The  preset  minimum  criteria  (default  values) 
provided  within  the  forward  inclusion  option  were  used  in 
order  to  obtain  statistical  information  on  a sufficient 


5The  least-squares  method  selects  the  regression 
model  which  minimizes  the  sum  of  the  squared  deviations  of 
the  actual  values  from  the  predicted  values  of  the  variable 
of  interest  (minimizes  2ej) . This  method  provides  the  best 
linear  unbiased  estimate  of  the  population  regression 
parameters  (18:401-403). 
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number  of  possibly  significant  variables  (15:345-346).  The 
output  of  the  SPSS  REGRESSION  subprogram  includes  not  only 
the  MLR  model  itself  but  also  the  statistical  information 
required  to  evaluate  it. 


Coefficient  of  determination.  The  coefficient  of  deter- 
2 

mination  (R  ) is  a measure  of  the  relative  efficiency  of  the 
MLR  model.  The  SPSS  forward  inclusion  option  utilizes  this 
measure  in  determining  the  order  in  which  independent  vari- 
ables are  entered.  It  is  defined  by  the  following  ratio: 

r2  _ explained  variation  (EV) 
total  variation  (TV) 


where: 


(Ey±)2 

n 


EV  = TV  - Ze2 
1 

2 

An  R of  0.8  or  greater  signifies  that  a "strong"  linear 
relationship  exists  between  the  dependent  and  independent 
variables  (10:19,62-63). 


Significance  of  overall  regression.  The  significance  of 

2 

the  relative  efficiency  (R  ) of  the  MLR  model  can  be  deter- 
mined utilizing  the  following  hypothesis  test: 


'o- 


B1  ~ b2  - 


= Bk  = 0 


at  least  one  Bj  ? 0 


j — 1,2,.  . • , k 


The  appropriate  test  statistic  is  given  by  the  following: 
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UJ,ip  *i* | 


1 


* 1 


R2/k 


P = 

0 (1  - R^)/(n  - k - 1) 

where:  k = number  of  independent  variables. 

The  test  is  conducted  as  a one-tailed  test  to  the  right: 

reject  H.  if  F.  > F , , . where  <*  is  the  level  of  signifi- 

-’0  0 <*;k,n-k-l 

cance,  1 - « is  the  confidence  level  (10:65),  k is  the 
numerator  degrees  of  freedom  and  n - k - 1 is  the  denominator 
degrees  of  freedom. 

* 

Significance  of  individual  regressors.  In  addition  to  over- 
all regression  significance  each  independent  variable  can  be 
evaluated  for  the  significance  of  its  contribution  to  the 
model.  The  appropriate  hypothesis  test  is  as  follows: 

V Bj  - 0 


Hx:  Bj  ft  0 


with  test  statistic: 


F0  " 


_b[ 


’b. 

3 


where  s^  is  the  estimator  of  the  deviation  of  the  regression 
coefficient  Bj  from  the  regression  of  Y on  all  X.  The  test 
may  be  conducted  with  variables  in  isolation  or  simultaneously. 
The  simultaneous  test  is  conducted  as  a one-tailed  test  to 
the  right:  reject  H.  if  F.  > F , , ..  , . where 

equivalent  * = « * number  of  variables  being  tested  simulta- 
neously. In  isolation,  the  test  is  conducted  as  a one-tailed 
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test  to  the  right:  reject  H.  if  F.  > F , , 

0 0 « ; 1 , n-» 


(10:72-75)  . 


Plot  of  standardized  residuals.  The  plot  of  standardized 
residuals  is  a scatterplot  of  the  deviations  of  the  observed 
values  from  the  predicted  values  of  the  dependent  variable. 

An  examination  of  the  overall  pattern  of  the  scatter  gives 
an  indication  of  the  extent  to  which  the  basic  assumptions 
of  linear  regression  are  met.  Figure  B.l  depicts  four  basic 
scatterplot  patterns.  Patterns  b,  c and  d indicate  the 
possibility  that  one  or  more  assumptions  have  been  violated. 
In  pattern  b,  the  variance  of  the  error  terms  is  not  constant 
for  all  observations.  In  patterns  c and  d,  the  error  terms 
are  not  uncorrelated  and  the  expected  values  of  the  error 
terms  are  not  zero  for  all  observations.  Additionally,  in 
pattern  d,  the  possibility  of  a curvilinear  relationship 
exists.  Pattern  a,  on  the  other  hand,  indicates  that  the 
basic  assumptions  of  linear  regression  have  not  been  violated 
(15:341-342) . 


Figure  B.l 

Basic  Scatterplot  Patterns 
Source ; (15:342) 
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Depot  Overhaul  Cost 

Depot  overhaul  costs  were  obtained  from  both  the 
WR-ALC  missile  production  manager  and  the  H036B  report. 
WR-ALC  furnished  unit  overhaul  costs  (OHC)  for  the  AIM-7E 
and  AGM-45  GCS  for  each  of  the  fiscal  years  1974-1977,  as 
contained  in  Table  C.l. 

To  provide  a single  data  point  for  the  AIM-7E  for 
each  fiscal  year,  a weighted  average6  was  determined  based 
on  the  two  depots.  Table  C.2  contains  these  weighted  aver- 
ages and  their  adjusted  values  based  on  the  Overhaul  Cost 
Indices  of  Table  A. 2,  page  60. 

To  provide  a single  point  for  the  AGM-45  for  each 
fiscal  year,  a GCS  depot  overhaul  unit  cost  was  obtained  by 
summing  the  unit  costs  for  each  of  the  components.  The  GCS 
depot  overhaul  unit  costs  and  their  adjusted  values  are  set 
forth  in  Table  C.3. 

The  AIM-9  OHC  data  were  obtained  from  the  H036B 
report.  A single  data  point  for  each  fiscal  year  for  each 
of  the  AIM-9B,  E and  J series  GCS  was  determined  by  calcu- 
lating a weighted  average  OHC  based  on  the  total  quantity 


The  data  sources  did  not  provide  the  cost  infor- 
mation on  an  individual  unit  basis.  Rather,  cost  data  were 
recorded  for  various  lots  of  various  quantities  for  a given 
time  period.  Since  SPSS  regression  treats  each  data  point 
equally,  it  was  necessary  to  develop  a representative  cost 
figure  for  each  particular  time  period  for  each  particular 
missile.  A weighted  average  approach  was  used  for  this  purpose. 
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Table  C.l 


WR- 

■ALC  OHC 

Data 

AIM-7E 

Depot 

FY74 

FY75 

FY76 

FY773 

Alameda 

2,332 

2,768 

2,900 

3,420 

Norfolk 

2,209 

2,548 

2,798 

3,350 

(All 

AGM-45 

Alameda 

Depot) 

Component 

FY74 

FY75 

FY76 

FY773 

Guidance 

940 

1,141 

953 

1,085 

Control 

397 

505 

417 

350 

FY77  includes  FY7T. 
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and  cost  of  overhaul  for  each  fiscal  year.  Table  C.4  con- 
tains these  weighted  average  costs  and  their  adjusted  values. 
The  AIM-9 J GCS  were  repaired  both  in-house  and  under  commer- 
cial contract.  The  first  listed  data  points  for  FY  76  and 
FY  7T  are  associated  with  commercial  contract  unit  prices. 


Table  C.4 

AIM-9  OHC  Input  Data 


Series 

FY 

Weighted 
Average  OHC 

Adjusted 

OHC  (FY  1977) 

B 

74 

530 

691 

76 

664 

716 

7T 

624 

646 

77 

434 

434 

E 

74 

649 

846 

75 

703 

814 

76 

1,298 

1,400 

7T 

1,097 

1,135 

77 

2,043 

2,043 

J 

74 

934 

1,217 

75 

1,046 

1,210 

76 

2,044 

2,204 

76 

1,581 

1,704 

?T 

1,267 

1,312 

7T 

1,299 

1,345 

77 

1,283 

1,283 
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Beginning  with  FY  7T,  the  H036B  report  contained 
interservicing  depot  overhaul  costs.  These  costs  were 
obtained  for  the  AIM-7E,  AIM-7F  and  AGM-45  and  are  set 
forth  in  Table  C.5  along  with  their  adjusted  values. 


Table  C.5 

Additional  OHC  Input  Data 


Missile 

FY 

OHC 

Adjusted 

OHC  (FY  1977) 

AIM-7E 

77 

2,768 

2,768 

AIM- 7Fa 

77 

4,836 

4,836 

AGM-4  5b 

77 

1,047 

1,047 

7T 

1 . 180 

1,221 

77 

1,011 

1,011 

Only  one  unit  was  repaired  in 
FY  7T  at  an  adjusted  OHC  of  $7,702.  In 
order  to  avoid  an  overemphasis  upon  this 
single  unit,  it  was  averaged  with  the 
units  repaired  in  FY  77. 


The  first  AGM-45  data  point  was 
determined  by  summing  the  weighted  averages  of 
the  MK36/MK49  guidance  units  and  the  weighted 
average  of  the  MK5-1/2  control  units.  The 
second  and  third  AGM-45  data  points  were  deter- 
mined by  summing  the  weighted  averages  of  the 
MK24/MK25  guidance  units  and  the  weighted 
average  of  the  MK1/MK5  control  units.  This 
distinction  was  required  because  the  MKl  control 
unit  cannot  be  used  with  the  MK36/MK49  guidance 
units . 
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Acquisition  Cost 

Acquisition  costs  (AC)  were  the  latest  purchase  price 
for  each  GCS  in  the  sample,  adjusted  to  constant  FY  1977 
dollars  in  accordance  with  the  Industry  Purchases  Index  in 
Table  A.l,  page  59.  These  cost  data  are  set  forth  in 
Table  C.6. 


Table  C.6 

Acquisition  Cost  Input  Data 


Missile 

Acquisition 
Completed  (FY) 

AC 

Adjusted 

AC  (FY  1977) 

AIM-7E 

1971 

16,984 

27,797 

AIM-7F 

Current 

95,000 

95,000 

AIM-9B 

1965 

1,497 

3,018 

AIM-9E 

1971 

3,196 

5,231 

AIM-9 J 

1975 

4,696 

5,448 

AGM-453 

27,457 

11,701 

19,579 

For  reasons  outlined  in  footnote  b to 
Table  C.5,  the  first  two  data  points  were  determined 
based  on  weighted  averages  of  adjusted  acquisition 
costs  of  separate  components.  The  third  data  point  is 
the  average  of  the  first  two  and  was  required  for  use 
with  the  AGM-45  OHC  data  obtained  from  WR-ALC,  since 
these  data  did  not  differentiate  between  the  two 
configurations . 
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Physical  Characteristics 

The  physical  characteristics  and  their  associated 
values  are  set  forth  in  Table  C.7.  For  reasons  outlined  in 
footnotes  to  Tables  C.5  and  C.6,  three  different  weights  for 
the  AGM-45  were  obtained,  one  for  each  configuration  and  an 
average  of  the  two.  All  other  physical  characteristics  are 
the  same  for  both  configurations. 

Time-Sharing  File 

All  data  for  depot  overhaul  cost,  acquisition  cost 
and  physical  characteristics  were  entered  on  a time-sharing 
file  which  is  reproduced  as  Figure  C.l.  The  data  matrix 
consists  of  29  lines  (data  points)  and  ten  columns.  The 
columns  from  left  to  right  represent  line  number,  depot  over- 
haul cost,  acquisition  cost,  number  of  subassemblies,  weight, 
length,  diameter,  volume,  categorical  variable  one  and 
categorical  variable  two. 


J 

■] 

j 

j 
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Physical  Characteristics  Input  Data 
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